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1 The Algorithm for Linear Programs 

Problem 1. Given a polyhedron P, written as Ax < b, find a point in P. 

Before tackling this problem, we begin with some definitions. A real symmetric matrix A 
with the property that x T Ax > for all x ^ is called positive definite. If A is positive 
definite, then there exists an invertible matrix P, such that A = P P. Let D be a positive 
definite matrix and consider the ellipsoid E11(D, z) = {x : (x — z) T D~ l (x — z) < 1}. Let 
v be the maximum number of bits required to describe a vertex of P and set R = 2 U . To 
solve Problem 1 we apply the following algorithm: 

The Ellipsoid Algorithm 

Start with the ellipsoid E = Ell(R 2 I, 0). 

At the i th iteration, check whether zi is in P. 

- YES. Output the feasible point. 

- NO. Find a constraint for P, at ■ x < violated by Z{. Recurse on Ei + ±, the minimum 
volume ellipsoid containing Ei n {x \ a& • x < at ■ zi}. 




Figure 1 : One cycle of the algorithm 



Observe that the algorithm halts when a point is found to be within P. It must halt, 
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since at any step i, P is a subset of Ei, and we will see that after each step, the volume of 
E{ + i has decreased by an appreciable amount. For some value of i, the volume of Ei will be 
smaller than the volume of P, so the algorithm must halt before reaching this point. In the 
next section we show that the algorithm can actually be implemented in polynomial time. 



2 The Time Bound 



Lemma 1. The minimum volume ellipsoid containing E11(D, z) Pi{x | a-x < a- z} is exactly 
E' = E11(D', z'), where 
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vol(E') 
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Sketch of proof : First, note that E11(A, 0) can be obtained from E11(I, 0) (the unit ball) 
using the transformation y = Bx, where A = B T B. To see this, consider the following: 

x T x < 1 

y T (B-Y(B- 1 )y = x T x 

y T (B-Y(B-')y < 1 

y T A- 1 y < 1 



where the first and last equations define the unit ball and E11(A, 0), respectively. 

Now, first we will prove the results (1) and (2) for the special case of the unit ball, E 
E11(J, 0). In this case, (1) reduces to 
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z = z — 
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and (2) reduces to 

, n 2 2 aa T 

Since E is a ball, we can rotate a without affecting anything. So, assume a = [1, 0, • • • , 0] T . 
Then, z' = [-l/(n + 1), 0, • • • ,0] T . 



2 




1 



The simplified statements for z' and D' can be proved by calculus. The general case is then 
proved by applying a transformation of A to the unit ball (B^ 1 above; the transformation 
scales the volume of a convex set by the factor det(-B)). 

Assuming (1) and (2), we can now prove (3). observe that: 

vol(Ell(£>', z 1 )) _ vol(Ell(/,0)) Vdet(i7) 
vol(Ell(A*)) ~ vol(Ell(/,0)) ySettW 

We transform space to take E to the unit ball. The transformed E' is still the minimum 
ellipsoid containing half of E. 
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Then, assuming D = I, we have y/det(D') = vol(E')/vol(E). Now we can use (2). 
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The determinant of this matrix is 

det(D') 
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Hence, 
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(using e 11 > 1 + x). 
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We need to calculate how small P can be in order to obtain a bound on the number of 
times we shrink E 1 . We will see that vol(P) > 2~ 2nu by finding a simplex inside P. Clearly 
the volume of the simplex will be less than or equal to the volume of P. 

Now there exist n + l affmely independent verticies of P, say xq, x\, . . . , x n . 
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vol(conv(x , • • . ,x n )) 
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A vertex X{ is a solution to a subset Cj of rows of Ax < b. We can solve for it using Cramer's 
Rule, Xij = ^/(p'^ , where is the matrix d with the i th column replaced by b restricted 
to the relevant rows for Cj. So, 
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Pulling out the denominators, we see that 
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det C\\ det C12 



det Cr, 
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n! det(Ci) det(C 2 ) ■ ■ ■ det(C„) 



After i steps, 



As detQ < 2", we have vol(conv(x , . . . , i n )) > n" n (2- !y ) n > 2~ 2ni/ . 
vol(^) < (2R) n e^T2. We stop before vol(^) < vol(P). Thus, 

2 (^+l)n e 2ST2 < 2~ 2nu 



which means we stop when i = 0{n 2 v). Recall that v was less than the number of bits 
required to write down any n x n subset of {A,b}, plus logn bits. So, the the number of 
iterations is 0(n 2 (C,d)). If we use L-bit numbers, then (C,d) = 0(n 2 L). To check the 
validity of a point, we must check each constraint of P, taking O(mn) time. This dominates 
the time required to calculate the minimum ellipsoid. So the total time required to complete 
the algorithm is at most 0(mn 5 L). 
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